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(54) Method and system for a mixed display of 2D and 3D images 



(57) An image display system includes a display ca- 
pable of performing mixed display of 2D and 3D images 
and a host computer for supplying image data to the dis- 
play. An image source generation unit of the host com- 
puter generates image data to be displayed on the dis- 
play. A 3D display position/area information generation 
unit generates area information indicating the 3D image 



area of the image data. A display mode setting unit gen- 
erates display mode information on the basis of the set- 
ting indicating whether to perform mixed display In the 
display, when a display mode detection unit detects the 
execution of mixed display from the display mode infor- 
mation, a 3D display position/area control unit ensures 
a 3D display area in accordance with the area informa- 
tion, and an image display unit performs mixed display. 
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Description 

BACKGROUND OF THE INVENTION 

FIELD OF THE INVENTION 

The present invention relates to an image display 
system including an image display apparatus which al- 
lows an observer to observe a 3D image (e.g stereo- 
scopic image by using the parallax between the right 
and left eyes of the observer) and a control apparatus 
for controlling the display apparatus, and a control meth- 
od therefor and, more particularly, to an image display 
system for providing an operation environment for com- 
fortable stereoscopic display, an image display appara- 
tus and an information processing apparatus in the sys- 
tem, and a control method and a storage medium used 
in the apparatuses. 

RELATED BACKGROUND ART 

A lenticular scheme and a parallax barrier scheme 
have been proposed as schemes for stereoscopic im- 
age display apparatuses using neither shutter glasses 
nor polarization glasses. In these apparatuses, special 
optical elements such as lenticular lenses and parallax 
barriers are generally placed on the front surface sides 
of display devices. These special optical elements are 
relatively inexpensive and exhibit high productivity. A 
simple stereoscopic image display apparatus can be 
easily constituted by a combination of such an optical 
element and a 2D display. These schemes are means 
especially effective for liquid crystal display devices 
(LCDs) and the like having flat display surfaces. 

For example, the parallax barrier scheme is dis- 
closed in S. H. Kaplan, "Theory of Parallax Barriers.", J. 
SMPTE, Vol. 59, No. 7, pp. 11 -21 (1952). According to 
this scheme, a vertically striped image obtained by al- 
ternately arranging at least right and left images of a plu- 
rality of parallax images from a plurality of viewpoints 
into a vertically 6triped pattern is observed through a slit 
pattern (called a parallax barrier) having predetermined 
opening portions placed at a predetermined distance 
from this image. With this operation, the right and left 
images of the vertically striped image are independently 
observed with the right and left eyes. As a result, paral- 
lax images corresponding to the right and left eyes are 
observed with the right and left eyes, thus realizing a 
stereoscopic view. 

Japanese Patent Laid-Open Nos. 3-119889 and 
5-1 22733 disclose stereoscopic display apparatuses in 
which a parallax barrier is electronically generated by a 
transmission type liquid crystal display device and the 
like, and the shape and position of each stripe are var- 
iably controlled to improve the compatibility with con- 
ventional 2D image display apparatuses. 

Fig. 11 shows the basic arrangement of the stereo- 
scopic image display apparatus disclosed in Japanese 



Patent Laid-Open No. 3-119889. This stereoscopic im- 
age display apparatus includes a transmission type liq- 
uid crystal display apparatus 11 for displaying parallax 
images and an electronic parallax barrier 1 3 constituted 

s by a transmission type liquid crystal display placed on 
the liquid crystal display apparatus 11 through a spacer 
12 having a thickness D. A parallax barrier pattern is 
displayed on the electronic parallax barrier 1 3. Note that 
a stereogram having, for example, right and left parallax 

io images alternately arranged into a vertically striped pat- 
tern is displayed on the liquid crystal display apparatus 
11. The spacer 12 is made of transparent glass, acrylic 
resin, or the like. 

In this stereoscopic image display apparatus, a ver- 

15 tically striped image consisting of parallax images 
sensed from two or more directions is displayed on the 
liquid crystal display apparatus 1 1 , and a parallax barrier 
pattern is formed at an arbitrary position on the barrier 
surface of the electronic parallax barrier 1 3 upon desig- 

20 nation of X and Y addresses by a control means such 
as a microcomputer 14, thereby allowing a stereoscopic 
view based on the principle of the above parallax barrier 
scheme. 

In this apparatus, when the display of the parallax 
25 barrier pattern on the electronic parallax barrier 13 is 
stopped to make the entire image display area of the 
electronic parallax barrier 1 3 colorless and transparent, 
2D image display can be performed. The compatibility 
between 2D display and 3D display is realized in this 
30 manner. 

An apparatus capable of performing mixed display 
of 3D and 2D images within a single plane is disclosed 
in Japanese Patent Laid-Open No. 5-1 22733. In this ap- 
paratus, as shown in Figs. 1 2A and 1 2B, a barrier striped 

35 pattern can be generated in the entire area or a partial 
area of the electronic parallax barrier 13. 

When a 3D display capable of performing mixed dis- 
play of 2D and 3D images is to be used, a system for 
controlling 2D and 3D display areas in accordance with 

40 the needs of the user is required. When the image in- 
formation generated by a computer is to be displayed, 
in particular, it becomes necessary to draw several win- 
dows on the screen of the display apparatus and selec- 
tively set the 2D and 3D display modes in units of win- 

45 dows. No conventional computer systems can serve 
such a purpose. 

SUMMARY OF THE INVENTION 

so The present invention has been made in consider- 
ation of the above problems, and has as its object to 
provide an image display system for providing an oper- 
ation environment for allowing proper setting of a display 
area for a 3D image in an image display apparatus ca- 

55 pable of performing mixed display of 2D and 3D images, 
and an image display apparatus and an information 
processing apparatus in the system. 

An embodiment of the present invention allows 
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setting of a display mode indicating whether to 
perform mixed display ol 2D and 3D images so as to 
allow more flexible setting of mixed display. 

An embodiment of the present invention allows 
setting of 2D and 3D image display modes in units 
of windows in displaying a plurality of windows. 

An embodiment of the present invention allows 
automatic display selling for 2D and 3D display 
modes in units of windows by using information about 
windows which is exchanged between an operating sys- 
tem and an application program. 

The present invention provides 
an image display system including an image dis- 
play apparatus capable of mixed display of 2D and 3D 
images, comprising first generation means for generat- 
ing image data to be displayed on the image display ap- 
paratus, second generation means for generating area 
information indicating a 3D image area of the image data 
generated by the first generation means, and control 
means for controlling 2D image display and 3D image 
display performed by the image display apparatus, on 
the basis of the area information. 
Preferably, the above image display system further 
comprises third generation means for generating dis- 
play mode information indicating whether to perform 
mixed display of 2D and 3D images, and the control 
means controls 2D image display and 3D image display 
performed by the image display apparatus when the dis- 
play mode information indicates execution of mixed dis- 
play. 

Preferably, in the above image display system, the im- 
age data corresponds to multi-window display, and the 
second generation means acquires information about 
window display which is to be exchanged between an 
application program and an operating system, and gen- 
erates the area information on the basis of the informa- 
tion about window display. 

In addition, according to the present invention, there 
is provided an image display apparatus and an informa- 
tion processing apparatus suited to the above image 
display system. 

Furthermore, according to the present invention, 
there is provided a control method for the above image 
display system, image display apparatus, and informa- 
tion processing apparatus. 

Other features and advantages of the present in- 
vention will be apparent from the following description 
taken in conjunction with the accompanying drawings, 
in which like reference characters designate the same 
or similar parts throughout the figures thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporat- 
ed in and constitute a part of the specification, illustrate 
embodiments of the invention and, together with the de- 
scription, serve to explain the principles of the invention. 



Fig. 1 is a block diagram showing the schematic ar- 
rangement of a display system according to an em- 
bodiment of the present invention; 
Fig. 2 is a block diagram for explaining the function- 
5 al arrangement of the display system of this embod- 
iment; 

Fig. 3 is a flow chart showing a procedure for gen- 
erating data for image display in a host computer; 
Fig. 4 is a flow chart showing an operation proce- 

10 dure in a display in this embodiment; 

Fig. 5 is a perspective view showing an apparatus 
designed to set a display mode with a hardware 
switch on the computer side; 
Fig. 6 is a perspective view showing an apparatus 

is designed to set a display mode with a hardware 
switch on the display side; 
Fig. 7 is a view showing a user interface used for 
"display mode" setting; 

Fig. 8 is a view showing a user interface used for 
20 "display mode" setting; 

Fig. 9 is a perspective view showing an apparatus 
designed to set a display mode by means of soft- 
ware on the display side; 

Fig. 1 0 is a flow chart for explaining a procedure for 
25 generating 3D display position/area signals in units 
of windows; 

Fig. 11 is a block diagram showing the basic ar- 
rangement of a stereoscopic image display appa- 
ratus of the parallax barrier scheme; and 
30 Figs. 1 2A and 1 2B are views each showing an ac- 
tual case in which mixed 2D/3D display is realized 
in the stereoscopic image display apparatus of the 
parallax barrier scheme. 

35 DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENT 

Preferred embodiments of the present invention will 
now be described in detail in accordance with the ac- 

40 companying drawings. 

A display system according to this embodiment in- 
cludes a stereoscopic display apparatus capable of per- 
forming mixed display of 2D and 3D images and a host 
computer for controlling the apparatus. 

45 Fig. 1 is a block diagram showing the schematic ar- 
rangement of the display system of this embodiment. 
Referring to Fig. 1, reference numeral 100 denotes a 
host computer; and 200, a display capable of stereo- 
scopic display. Note that the display 200 uses the above 

50 electronic parallax barrier, can perform mixed display of 
2D and 3D images, and allows a stereoscopic view at 
an arbitrary position. The stereoscopic view scheme ap- 
plied to the display 200 is not limited to the parallax bar- 
rier scheme : and another scheme may be used. 

55 in the host computer 100, a CPU 101 realizes var- 
ious types of control operations in accordance with the 
control programs stored in a ROM 102 or a RAM 103. 
Reference numeral 104 denotes an external memory 
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constituted by a hard disk or a floppy disk, in which an 
operating system (to be referred to as an OS hereinaf- 
ter), application programs, and the like are stored. The 
control programs stored in the external memory 104 are 
loaded into the RAM 103 and executed by the CPU 101. 
Reference numeral 105 denotes an input unit constitut- 
ed by a keyboard, a pointing device (a mouse in this 
embodiment), and the like; and 106, a display interface 
for communicating "image source information", "display 
mode information", and "3D display position/area infor- 
mation" with the display 200. The contents of these data 
will be described later. 

In the display 200, a controller 201 includes a CPU 
201a, a ROM 201b, and the like and performs various 
control operations for the display 200. Reference nu- 
meral 202 denotes an interface for performing data com- 
munication with the host computer 100; 205, an elec- 
tronic parallax barrier (corresponding to the electronic 
parallax barrier 13 described in "RELATED BACK- 
GROUND ART") constituted by a transmission type liq- 
uid crystal display for displaying a parallax barrier pat- 
tern; 206, a liquid crystal display for displaying 2D and 
3D images (corresponding to the transmission type liq- 
uid crystal display apparatus 11); 203, a barrier pattern 
driver for driving the electronic parallax barrier 205 to 
display a pattern; and 204, an image display driver for 
driving the liquid crystal display 206 to display an image. 
Note that a spacer (not shown; corresponding to the 
spacer 12 described in "RELATED BACKGROUND 
ART") is arranged between the electronic parallax bar- 
rier 205 and the liquid cryslal display 206. Reference 
numeral 300 denotes a connection cable for connecting 
the interlaces 106 and 202 to each other. 

Fig. 2 explains the functional arrangement of the 
display system of this embodiment. The operation of the 
embodiment will be described below with reference to 
Fig. 2. 

This display system is constituted by the host com- 
puter 100, the display 200, and a communication unit 
for performing data communication therebetween. The 
communication unit is a portion for exchanging signals 
between the host computer 100 and the display 200, 
and includes the interlaces 106 and 202 and the con- 
nection cable 300. 

The host computer 100 includes a display mode 
setting unit 1 21 for generating display mode information, 
a 3D display position/area information generation unit 
122 for generating 3D display position/area information, 
and an image source generation unit 1 23 for generating 
image source information. Note that the above respec- 
tive functions in the host computer 1 00 are implemented 
when the CPU 101 executes the control programs load- 
ed into the RAM 1 03. The 3D display position/area in- 
formation indicates both the position and size of a 3D 
display portion, and has, for example, a data configura- 
tion of (x, y, width, height) = (x-coordinate on upper left 
portion of window, y-coordinate on upper left portion of 
window, window width, window height). Note that 3D 



display position/area information and the 3D display po- 
sition/area information generation unit 122 will be re- 
spectively referred to as 3D display information and the 
3D information generation unit 122 hereinafter. 

5 Fig. 3 is a flow chart showing a procedure for gen- 
erating data for image display in the host computer 1 00. 

When an image source generation instruction is re- 
ceived in step S1 1 , the flow advances to step S12. Dis- 
play mode information is generated by the display mode 

10 setting unit 121. The display mode setting unit 121 dis- 
criminates whether the user of this system is demanding 
the 2D display mode or the mixed 2D/3D display mode 
(to be relerred to as the 3D display mode hereinafter), 
and generates different types of display mode informa- 
tion (a 2D mode signal and a 3D mode signal in this em- 
bodiment) depending on the discrimination result (steps 
S13 and S21). Note that mode setting is implemented 
by a hardware switch, a menu operation, and the like, 
as will be described later with reference to Figs. 5 to 9. 

20 if the 3D display mode is selected as the current 
display mode, the computer causes the image source 
generation unit 123 and the 3D information generation 
unit 1 22 to generate a 3D image source signal and a 3D 
display information signal, respectively (steps S14 and 

25 S1 5). As a result, the three types of signals, i.e., the 3D 
mode signal, the image source signal, and the 3D dis- 
play information signal, are transmitted to the display 
(step S16). In this case, the 3D display information sig- 
nal contains information associated with the area and 

30 position where 3D display is to be performed (a proce- 
dure for generating this signal will be described in detail 
later with reference to Fig. 10). The 3D image source 
signal in this case is a signal having a 3D display image 
source in at least a portion of an image source. This sig- 

35 nal contains an image signal mixture of 2D and 3D im- 
age signals. 

If the 2D display mode is selected as the current 
display mode, the image source generation unit 123 
generates 2D image source information (step S22). In 

40 the 2D display mode, since there is no need to generate 
a 3D display information signal, the 3D information gen- 
eration unit 122 is not used. As a result, the two types 
of signals, i.e., the 2D mode signal and the 2D image 
source signal, are transmitted to the display (step S23). 

45 In step S22, image data corresponding to 3D image 
display may be converted into a 2D image source signal. 
When, for example, image data consisting of right and 
left parallax images alternately arranged into a vertically 
striped pattern is to be used, it suffices to generate im- 

50 age data designed to display right or left parallax images 
two stripes at a time. 

The format of the image source information output 
from the host computer 100 depends on the processing 
system on the display side which receives the signal and 

55 the manner in which the display distributes right/left-eye 
parallax values to the right and left eyes of the observer 
in displaying an image. If, for example, the image display 
unit of the display can process only the same general 
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image signal (e.g., a VGA signal or an NTSC signal) as 
that in a conventional 2D display, the host computer 100 
outputs an image source signal having a format corre- 
sponding to such a signal. It a special image signal (2D 
image signal + right/left-eye parallax signal or the like) 
for a 3D display can be processed and displayed by the 
image display unit, the host computer 100 outputs an 
image source signal having a format suited to the 
processing system. If the display is of the type that re- 
alizes a stereoscopic vision by the liquid crystal shutter 
glasses scheme, the M 3D image source" becomes a 
"time-division parallax image source" designed to 
switch right and left parallax images in synchronism with 
the ON/OFF period of the liquid crystal shutter. If the 
display is based on the "parallax barrier scheme" or the 
"lenticular scheme', a "parallax striped image source" 
having right and left parallax images alternately ar- 
ranged into a vertically striped pattern is used. 

The various types of signals generated by the host 
computer 100 in the above manner are sent to the dis- 
play 200 through the communication unit. The commu- 
nication unit is constituted by the interfaces (to be re- 
ferred to as the l/Fs hereinafter) 106 and 202 and the 
connection line, which connect the computer and the 
display to each other. Of the above signals, the image 
source information is generally sent from the standard 
output l/F (e.g., a D-sub connector) of the computer to 
the display which is connected to the computer through 
a general display cable. In the system of this embodi- 
ment, however, since the display mode information and 
the 3D display information must also be transmitted to 
the display, these signals are transmitted by using the 
following l/Fs. 

Serial or Parallel Port 

A general computer has a serial port (RS232C) 
and a parallel port as digital signal output means. 
The above signals can be output to the display by 
using these ports. Digital signal output from the re- 
spective ports are generated by software on the PC 
and PC hardware. . Next-generation Digital l/F 

Several next-generation l/Fs for connecting 
computers and peripheral devices to each other 
have been proposed. IEEE1394 and USB are typi- 
cal examples. Although only a minority of PCs are 
equipped with these l/Fs at present, it is expected 
that such PCs will increase in number in the future. 
IEEE1 394 in particular is a high-speed, broadband 
digital l/F with excellent image signal transmission 
performance, which can transmit the above three 
types of signals from the computer to the display at 
once. Dedicated digital l/Fs for connecting comput- 
ers and displays have also been proposed. When 
such an l/F is to be used, display mode information 
and 3D display information are transmitted by using 
a signal transmission area of this l/F other than an 
image signal transmission area. 
Standard Video Output 



As a standard l/F for connecting a computer 
and a display, an analog signal output l/F designed 
to transmit only image signals is currently used. For 
example, a connection cable of the D-sub scheme 

5 which is the standard video output of a DOS/V PC 
uses 15 pins as terminals. Of these 15 pins, how- 
ever, only about six pins are used to transmit an im- 
age signal, and about nine remaining pins are not 
used. If : therefore, these unused pins are used to 

'0 transmit signals other than image signals, the two 
other types of signals can be transmitted at the 
same time while the conventional standard video 
output l/F cable is used. 
Extension l/F Board 

15 If there is no l/F suited to the computer, a ded- 

icated extension l/F board can be mounted in the 
computer to be used for connection to the display. 
When a dedicated l/F board is to be used for this 
system, the use environment of the display can be 

20 made more comfortable by adding the function of 
helping the generation of the above three types of 
information, i.e., display mode information, 3D dis- 
play information, and image source information, to 
the l/F board. 

25 The operation of the display 200 will be briefly 

described next. The display 200 includes a display 
mode detection unit 221 , a 3D display position/area 
control unit 222, and an image display unit 223 as 
signal processing units for executing processes us- 

30 ing the above signals. A display mode signal, a 3D 
display information signal, and an image source sig- 
nal are respectively used by the display mode de- 
tection unit 221 , the 3D display position/area control 
unit 222, and the image display unit 223. Note that 

35 the functions of these units are implemented when 
the CPU 201a in the controller 201 executes the 
control programs stored in the ROM 201 b. The 3D 
display position/area control unit 222 will be re- 
ferred to as the 3D display control unit 222 herein- 

40 after. 

Fig. 4 is a flow chart showing an operation proce- 
dure in the display of this embodiment. Note that the 
processing shown in Fig. 4 is implemented when the 
45 CPU 201a executes the control programs stored in the 
ROM 201b. 

In step S31 , signals representing display mode in- 
formation, 3D display information, and image source in- 
formation are input from the host computer 100. In step 
so S32, of the signals input to the display 200, the display 
mode information is processed by the display mode de- 
tection unit 221. In this step, it is discriminated whether 
the display mode selected by the user is the 2D or 3D 
display mode. 

55 if it is discriminated that the 2D display mode is se- 
lected, the flow shifts to the 2D display routine after step 
S41 . In the 2D display routine, the image source signal 
is sent to the image display unit to be processed. As 
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described above, the image source signal output from 
the computer may have a format selected from a plural- 
ity of formats. In some case, therefore, the image source 
signal must be converted into a signal having an optimal 
format for image display within the image display unit 
223 of the display 200. In this case, the above format 
conversion indicated by the dotted line in Fig. 4 is per- 
formed by the "image display signal generation unit" 
(step S41). In step S42. image display is performed. In 
thiscase, the entire display surface of the electronic par- 
allax barrier 205 is set in a transparent state without dis- 
playing any barrier pattern thereon, and a 2D image is 
displayed on the liquid crystal display 206. Obviously, if 
the above format conversion need not be performed, 2D 
display based on the image source is performed in step 
S42 without the mediacy of the "image display signal 
generation unit". 

If it is discriminated that the 3D display mode is set, 
it is further discriminated whether the image source is 
capable of generating a 3D image (step S33). This dis- 
crimination is performed by checking whether the signal 
from the host computer contains the 3D display infor- 
mation signal generated by the 3D information genera- 
tion unit 1 22. If it is discriminated that a 3D image cannot 
be generated (there is no 3D display information), the 
flow shifts to the above 2D display routine. If it is dis- 
criminated that a 3D image can be generated, the flow 
shifts to the 3D display routine after step S34. 

In the 3D display routine, 3D display position/area 
control is performed concurrently with image display 
(image display and 3D display position/area control are 
processes to be performed in an arbitrary order. They 
may be processed concurrently). 

The 3D display information signal is processed by 
the 3D display conlrol unit 222. First of all, pieces of in- 
formation about the 3D display position and area are ac- 
quired (step S34). The 3D display control unit 222 fur- 
ther performs processing on the basis of these pieces 
of information to ensure a display area (step S35). 

The above control operation will be described in de- 
tail. The display 200 displays a vertically striped image 
consisting of parallax images sensed from two or more 
directions on the liquid crystal display 206, and forms a 
parallax barrier pattern at/in an arbitrary position/area 
on the electronic parallax barrier 205 constituted by a 
liquid crystal display stacked on the liquid crystal display 
206, thereby realizing a stereoscopic vision on the basis 
. of the principle of the parallax barrier scheme. In the 
colorless, transparent area, on the electronic parallax 
barrier 205, on which no barrier pattern is displayed, the 
2D image displayed by the liquid crystal display 206 can 
be observed as it is. As a result, the 3D image can be 
observed in the area on the electronic parallax barrier 
205 on which the parallax barrier pattern is displayed, 
whereas the 2D image can be observed in the remaining 
area. 

When the above 3D display is used, since the above 
3D display information has been acquired by the 3D dis- 



play control unit 222, the barrier pattern is displayed at/ 
in only the corresponding position/area on the electronic 
parallax barrier 205, but the remaining area is kept in a 
colorless, transparent state. If, for example, the 3D dis- 
5 play information indicates an area 205a, the barrier pat- 
tern is displayed in only the area 205a. In this manner, 
both a 2D display area and a 3D display area can be 
ensured. 

The image display unit 223 performs signal 
10 processing for 3D display (including mixed 2D/3D dis- 
play) on the basis of the sent image source signal. As 
described above, the image source signal output from 
the computer may have a format selected from a plural- 
ity of formats. In some case, therefore, the image source 
15 signal must be converted into a signal having an optimal 
format for image display within the image display unit of 
the display. In this case, the format conversion indicated 
by the dotted line in Fig. 4 is performed by the "image 
display signal generation unit" (step S36), and image 
20 display is executed (step S37). At this time, image dis- 
play signals for 2D and 3D display areas are generated 
on the basis of the above 3D display information. Refer- 
ring to Fig. 1 , for example, a 3D image (an image con- 
sisting of right and left parallax images alternately ar- 
25 ranged into a striped pattern in this embodiment) is dis- 
played in an area 206a, and a 2D image is displayed in 
the remaining area. In this case, the areas 205a and 
206a correspond to the display areas determined by the 
3D display information, and the 3D image is observed 
30 in these areas. 

Obviously, if the above format conversion is not re- 
quired, image display is performed by using the image 
source signal as an image display signal without the me- 
diacy of the "image display signal generation unit". 
35 As described above, according to this embodiment, 
there is provided a display system including a stereo- 
scopic image display apparatus capable of switching the 
2D and 3D display modes in accordance with the inten- 
tion of the user and automatically performing mixed dis- 
40 play of 2D and 3D images, and a host computer for con- 
trolling the display apparatus. 

A method of generating display mode information 
and 3D display information, which are important pieces 
of information in this embodiment will be described in 
45 detail next. 

The following four methods can be conceived as 
methods of generating display mode information: 

(1 ) a method of generating information on the basis 
50 of the setting made by a hardware switch arranged 

on the computer; 

(2) a method of generating information on the basis 
of the setting made by a hardware switch arranged 
on the display; 

55 (3) a method of generating information on the basis 
of the setting made by a switch on software in the 
computer; and 

(4) a method of generating information on the basis 
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of the setting made by a switch on software in the 
display. 

Fig. 5 is a schematic perspective view of the appa- 
ratus using method (1 ) described above. Fig. 6 is a sche- 
matic perspective view of the apparatus using method 
(2) described above. Referring to Figs. 5 and 6, refer- 
ence symbol SW denotes a switch for switching the 2D 
and 3D display modes. Note that the switch SW is in- 
cluded in the input unit 105. 

In addition to the above two types of display modes 
(2D and 3D display modes), a plurality of parameters 
such as a parameter that limits a criterion for determin- 
ing the execution of 3D display or the time during which 
3D display is to be performed, a parameter that limits 
the size of a 3D area, and the like can be set. When 
there are many items to be set as in this case, setting 
can be performed more easily with software switches as 
in methods (3) and (4). 

A setting operation based on method (3) will be de- 
scribed in detail below. In general, when an operation is 
to be performed by using a computer, a systematic op- 
eration environment is constructed by using software 
called an operating system (to be referred to as an OS 
hereinafter), and various application software programs 
are operated on the OS. Setting associated with an op- 
eration environment such as display mode setting for a 
display is often performed by using an environment set- 
ting application incorporated in the OS in advance. Fig. 
7 shows an example of how the above display mode 
setting operation is performed on a "display" setting 
menu in an environment setting application in "Windows 
95" (trademark) of Microsoft Corporation, which is a typ- 
ical OS of personal computers (to be referred to as PCs 
hereinafter). 

Display mode setting is performed on a "3D display" 
setting menu on the "display" setting window. The user 
selects either the 2D display mode or the 3D display 
mode on this menu. If the user selects the 3D display 
mode, he/she can further set parameters that define 
conditions for 3D display, e.g. , the maximum continuous 
3D display time and the maximum 3D display area. In 
using an OS having a user interface which activates a 
plurality of work windows to execute jobs in units of win- 
dows, like "Windows 95" (trademark), in particular, ben- 
eficial effects can be obtained when the 3D or 2D display 
mode is set in accordance with the state of each window 
or the type of image to be processed on each window. 
Obviously, the user can set the above maximum contin- 
uous 3D display time and the maximum 3D display area 
for each window. 

In the case shown in Fig. 7, the user can select a 
mode (Auto 1 ) of performing 3D display on all windows 
that handle images which can be displayed as 3D im- 
ages, a mode (Auto 2) of performing 3D display on only 
the active window of the above windows, or a mode 
(Manual) of checking the user's intention of performing 
3D display every time 3D display can be performed. The 



user can further set the maximum continuous 3D display 
time, whether to generate a warning message, and the 
maximum 3D display area. 

The user may also set a mode of always performing 

5 3D display at/in a specific position/area on the screen 
independently of windows, with the remaining area serv- 
ing as a 2D display area. For example, Fig. 8 shows the 
items to be set in this case. Referring to Fig. S, set values 
in "Width" and "Height" indicate the size of the 3D dis- 

10 play area, and set values in "Left" and "Top" indicate the 
position of the 3D display area. 

Similarly, in method (4) described above, the same 
display mode setting screen as that in method (3) de- 
scribed above is displayed on the display to allow the 

is user to perform a setting operation. In this case, various 
selection buttons (arrow keys, a confirmation key, and 
the like) are arranged on the display, as shown in Fig. 
9, to allow the user to make various settings. Methods 
(2) and (4), however, require an arrangement for notify- 

20 ing the host computer 100 of the contents of settings 
made on the display side. 

When a display mode can be set on the display side 
as in methods (2) and (4), the display made detection 
unit 221 notifies the display mode setting unit 121 of the 

25 set display mode through the communication unit in- 
cluding the interfaces 202 and 106 and the connection 
cable 300. The display mode determination processing 
in step S12 is therefore performed on the basis of the 
display mode notified by the display mode detection unit 

30 221 . Furthermore, in this case, the display mode detec- 
tion unit may perform determination processing in step 
S32 in Fig. 4 in accordance with the display mode set 
on the display side. With this operation, the display 
mode information can be omitted from the information 

35 notified from the host computer 100. 

A method of generating 3D display information will 
be described next. As shown in Fig. 2 as well, when the 
3D display mode is set, pieces of 3D display information 
are generated in the host computer. These pieces of in- 

40 formation are generated in a proper format on the basis 
of various pieces of information in the display mode set 
by the user. An information generation method for each 
display mode setting will be described below. 

^5 (1) Setting 3D Display Area for Each Window 

A case in which the OS of the computer has a 
user interface for executing jobs in un its of windows, 
like "Windows 95" (trademark), and 3D display ar- 
eas are set in units of windows will be described 

so first. 

In general, the OS generates a window in re- 
sponse to a request from an application. The appli- 
cation determines information (size and position) 
required to generate a window, and the OS pre- 
55 pares for the generation of the window by referring 
to the information. When, for example, an image is 
to be displayed upon reading an existing image 
source file, the application determines the size of a 
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window by referring to the information (resolution, 
size, and the like) written in the image source file, 
and outputs an instruction lor generating a window 
corresponding to the determined size to the OS. 
When an image is to be generated in real time as 5 
well, the application determines the size and reso- 
lution of the image first, and the OS then executes 
an instruction for generating a window correspond- 
ing to the determined size, thus drawing the image. 
In addition, the application determines the proper 10 
position of the window in accordance with the oper- 
ation state, and transfers the corresponding infor- 
mation to the OS. In most cases, a window can be 
moved to an arbitrary place in accordance with the 
user's intention, and the position information of the *5 
destination of the window is also detected by the 
application and transferred to the OS. 

These pieces of position and area information 
of a window are generated by an application, and 
the OS acquires them. When, therefore ; 3D display 20 
areas are to be controlled in units of windows, 3D 
display information may be generated on the basis 
of these pieces of information transferred from an 
application to the OS. 

If, however, a 2D image is to be displayed in a 25 
window, or the 3D display conditions ("maximum 3D 
display area", "window is active"., and the like) set 
in the process of setting a display mode are not sat- 
isfied, no 3D display information should be gener- 
ated for this window. The 3D information generation 30 
unit 1 22 in Fig. 2 therefore generates 3D display in- 
formation while performing such determination 
processing. 

Fig. 10 is aflow chart for explaining a procedure 
for generating 3D display position/area signals in 35 
units of windows. Note that this processing is exe- 
cuted when the 3D display mode is designated. 

In step S1 01 , it is checked whether an applica- 
tion has issued a window generation instruction to 
the OS. If the window generation instruction is de- *o 
tected, the flow advances to step S102 to acquire 
pieces of information indicating the size and posi- 
tion of the window which are contained in the win- 
dow generation instruction. If "Auto 1 " is designated 
on the menu shown in Fig. 7, since all windows ca- 45 
pable of 3D display are set as windows subjected 
to 3D display, the flow advances to step S106. If 
"Auto 2" is designated, since only an active window 
becomes a window to be subjected to 3D display, 
the flow advances to step S105 to check whether so 
the window is active. If it is determined that the win- 
dow is active, the flow advances to step S106. Oth- 
erwise, the flow returns to step S101. 

In step S106, it is checked whether 3D display 
of the contents to be displayed in the window can ss 
be performed. If it is determined that 3D display can 
be performed, the flow advances to step S1 07. Oth- 
erwise, the flow returns to step S1 01 . 



In step S107 : it is checked whether "Manual" is 
designated. If it is determined that "Manual" is not 
designated, the flow advances to step S110 to set 
the pieces of position and area information of the 
window as pieces of information subjected to 3D 
display processing. If it is determined in step S107 
that "Manual" is designated, the flow advances to 
step S108 to inquire of the user whether he/she 
wishes to perform 3D display in the window. If the 
user's replay to this inquiry is "YES", the flow ad- 
vances to step S110 to set the pieces of position 
and area information of the window as pieces of in- 
formation to be subjected to 3D display processing. 
If the user's replay is "NO", the flow returns to step 
S101. 

Pieces of 3D display information are generated 
in units of windows in the above manner. Assume 
that the displayed window is switched from the ac- 
tive state to the inactive state, or from the inactive 
state to the active state. In this case, every time "Au- 
to 1" is selected, the pieces of 3D display position 
and area information are updated. A window gen- 
eration instruction in step S101 therefore contains 
information about a given window which is changed 
from the active state to the inactive state or from the 
inactive state to the active state. 

In the "Manual" mode, every time a window is 
switched from the active state to the inactive state, 
it is checked whether to perform 3D display. 

Note that the 3D information generation unit 
1 22 may be incorporated in an application or pre- 
pared by the OS. In addition, the corresponding por- 
tion may be replaced with hardware. In any case, 
the pieces of 3D display position and area informa- 
tion generated by the 3D display control unit 222 
are converted into a signal having a format suited 
to transmission, and the signal is output to the dis- 
play 200 through the above communication unit. 

(2) Fixed 3D Display Area 

When a 3D display area is designated on the 
display mode setting menu in Fig. 8, 3D display is 
always performed at/in a specific position/area on 
the screen independently of windows, and 2D dis- 
play is performed in the remaining area. In this case, 
3D display information is fixed and notified to the 
display 200 through the above communication unit. 

As long as the above display mode continues 
on the display, 3D display position/area control on 
the specific area is continuously performed. 

(3) Combining modes (1 ) and (2) 

3D display may be performed in a display mode 
set as a combination of modes (1) and (2). In this 
mode, therefore, 3D display is performed in units of 
windows within a predetermined area. In this case, 
it suffices if a 3D display position and area are ob- 
tained by the method in mode (1 ), and pieces of in- 
formation are generated by setting an area where 
the obtained area overlaps a fixed 3D area as a true 
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3D display position and area, 
f N As described above, according to the above 

embodiment, there is provided a computer system 
which can control the image information generated 
by a computer upon dividing an arbitrary area on 5 
the screen into 2D and 3D display areas by using a 
stereoscopic image display apparatus capable of 
performing mixed display of 2D and 3D images. 

Note that the present invention may be applied 
to either a system constituted by a plurality of equip- 10 
ments (e.g. : a host computer, an interface device, 
a reader, a printer, and the like), or an apparatus 
consisting of a single equipment (e.g. : a copying 
machine, a facsimile apparatus, or the like). 

The objects of the present invention are also *5 
achieved by supplying a storage medium, which 
records a program code of a software program that 
can realize the functions of the above-mentioned 
embodiments to the system or apparatus, and read- 
ing out and executing the program code stored in 20 
the storage medium by a computer (or a CPU or 
MPU) of the system or apparatus. 

In this case, the program code itself read out 
from the storage medium realizes the lunctions of 
the above-mentioned embodiments, and the stor- 25 
age medium which stores the program code consti- 
tutes the present invention. 

As the storage medium for supplying the pro- 
gram code, for example, a floppy disk, hard disk, 
optical disk, magneto-optical disk, CD-ROM, CD-R, 30 
magnetic tape, nonvolatile memory card, ROM, and 
the like may be used. 

The functions of the above-mentioned embod- 
iments may be realized not only by executing the 
readout program code by the computer but also by 35 
some or all of actual processing operations execut- 
ed by an OS (operating system) running on the com- 
puter on the basis of an instruction of the program 
code. 

Furthermore, the functions of the above-men- 40 
tioned embodiments may be realized by some or all 
of actual processing operations executed by a CPU 
or the like arranged in a function extension board or 
a function extension unit, which is inserted in or con- 
nected to the computer, after the program code read 45 
out from the storage medium is written in a memory 
of the extension board or unit. 

As has been described above, according to the 
present invention, in an image display capable of 
performing mixed display of 2D and 3D images, a so 
3D display area can be arbitrarily set. 

In addition, according to the present invention, 
in a window display system, the 3D and 2D display 
modes can be switched in units of windows. 

As many apparently widely different embodi- ss 
ments of the present invention can be made without 
departing from the spirit and scope thereof, it is to 
be understood that the invention is not limited to the 



specific embodiments thereof except as defined in 
the claims. 



Claims 

1. An image display system including an image dis- 
play apparatus capable of mixed display of 2D and 
3D images, characterized by comprising: 

first generation means (123) for generating im- 
age data to be displayed on said image display 
apparatus; 

second generation means (122) for generating 
area information indicating a 3D image area of 
the image data generated by said first genera- 
tion means; and 

control means (222, 223) for controlling 2D im- 
age display and 3D image display performed 
by said image display apparatus, on the basis 
of the area information. 

2. The system according to claim 1 , f u rther comprising 
third generation means (121 ) for generating display 
mode information indicating whether to perform 
mixed display of 2D and 3D images, and 

wherein said control means controls 2D image 
display and 3D image display performed by 
said image display apparatus when the display 
mode information indicates execution of mixed 
display 

3. The system according to claim 2, further comprising 
setting means (Figs. 5 to 9) for performing a setting 
operation to determine whether to perform mixed 
display of 2D and 3D images, and 

wherein said third generation means generates 
the display mode information on the basis of 
contents set by said setting means. 

4. The system according to claim 3, wherein said im- 
age display system further comprises said image 
display apparatus and a host apparatus for supply- 
ing image data to said image display apparatus, and 

said setting means is a hardware switch provid- 
ed for said host apparatus. 

5. The system according to claim 3, wherein said im- 
age display system further comprises said image 
display apparatus and a host apparatus for supply- 
ing image data to said image display apparatus, and 

said setting means is a hardware switch provid- 
ed for said image display apparatus. 
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6. The system according to claim 3, wherein said im- 
age display system further comprises said image 
display apparatus and a host apparatus for supply- 
ing image data to said image display apparatus, and 

said setting means is incorporated in software 
executed by said host apparatus. 

7. The system according to claim 6, wherein said soft- 
ware is incorporated in an operating system. 

8. The system according to claim 6, wherein said soft- 
ware is incorporated in an application program. 

9. The system according to claim 3, wherein said im- 
age display system further comprises said image 
display apparatus and a host apparatus for supply- 
ing image data to said image display apparatus, and 

said setting means is incorporated in software 
executed by said image display apparatus. 

10. The system according to claim 2, wherein said first 
generation means converts 3D display image data 
into 2D display image data when the display mode 
information generated by said third generation 
means indicates a mode of displaying only a 2D im- 
age. 

11. The system according to claim 1, wherein the image 
data corresponds to multi-window display, and 

said second generation means acquires infor- 
mation about window display which is to be ex- 
changed between an application program and 
an operating system, and generates the area 
information on the basis of the information 
about window display. 

12. The system according to claim 11, further compris- 
ing determination means (S106) for determining for 
each of the plurality of windows whether data cor- 
responding to 3D display is contained, and 

wherein said second generation means gener- 
ates the area information on the basis of a dis- 
play area of a window determined as a window 
containing data corresponding to 3D display by 
said determination means. 

1 3. The system according to claim 1 2, wherein said de- 
termination means generates the area information 
on the basis of a display area of a window, of the 
plurality of windows, which is active and contains 
data corresponding to 3D display. 

14. The system according to claim 1 2, wherein said de- 
termination means generates the area information 



on the basis of a display area of a window, of the 
plurality of windows, which contains data corre- 
sponding to 3D display and designated as a window 
to be subjected to 3D display. 

s 

15. An image display apparatus capable of performing 
mixed display of 2D and 3D images, characterized 
by comprising: 

10 first reception means (223) for receiving image 

data to be displayed on said image display ap- 
paratus; 

second reception means (222) for receiving ar- 
ea information indicating a 3D image area of 
*s the image data; and 

control means (223) for controlling 2D image 
display and 3D image display on the basis of 
the area information when an image formed by 
the image data is to be displayed. 

20 

16. The apparatus according to claim 15, further com- 
prising third reception means (221) for receiving 
display mode information indicating whether to per- 
form mixed display of 2D and 3D images, and 

25 

wherein said control means controls 2D image 
display and 3D image display performed by 
said image display apparatus on the basis of 
the area information when the display mode in- 
30 formation indicates execution of mixed display. 

17. The apparatus according to claim 15, further com- 
prising 

35 setting means (Figs. 6 and 9) for setting a dis- 

play mode indicating whether to perform mixed 
display of 2D and 3D images, and 
notification means (221) for notifying a source 
of the image data of the display mode informa- 

40 tion set by said setting means, and 

wherein said control means controls 2D image 
display and 3D image display performed by 
said image display apparatus on the basis of 
the area information when the display mode set 

45 by said setting means indicates execution of 

mixed display. 

18. An information processing apparatus which can be 
connected to an image display apparatus capable 

so of performing mixed display of 2D and 3D images, 
characterized by comprising: 

first generation means (123) for generating im- 
age data containing both 2D and 3D image da- 
55 ta; 

second generation means (122) for generating 
area information indicating a 3D display area of 
the image data generated by said first genera- 
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tion means; and 

output means (123) tor outputting the image da- 
ta and the area intormation to said image dis- 
play apparatus. 

19. The apparatus according to claim 18, further com- 
prising third generation means (121) for generating 
display mode information indicating whether to per- 
form mixed display of 2D and 3D images, and 

wherein said output means outputs the image 
data, the area information, and the display 
mode information to said image display appa- 
ratus. 

20. The apparatus according to claim 19, further com- 
prising setting means (Figs. 5, 7, and 8) for perform- 
ing a setting operation to determine whether to per- 
form mixed display of 2D and 3D images, and 

wherein said third generation means generates 
the display mode information on the basis of 
contents set by said setting means. 



25. The apparatus according to claim 22, wherein said 
determination means generates the area informa- 
tion on the basis of a display area of a window : of 
the plurality of windows, which contains data corre- 

5 sponding to 3D display and designated as a window 
to be subjected to 3D display 

26. A method of controlling an image display system in- 
cluding an image display apparatus capable of 

10 mixed display of 2D and 3D images, characterized 
by comprising: 

the first generation step (S14, S22) of generat- 
ing image data to be displayed on said image 
15 display apparatus; 

the second generation step (S1 5) of generating 
area information indicating a 3D image area of 
the image data generated in the first generation 
step; and 

20 the control step (S34 - S37) oi controlling 2D 

image display and 3D image display performed 
by said image display apparatus, on the basis 
of the area information. 



21. The apparatus according to claim 19, wherein said 
first generation means converts 3D display image 
data into 2D display image data when the display 
mode information generated by said third genera- 
tion means indicates a mode of displaying only a 
2D image. 

22. The apparatus according to claim 18, wherein the 
image data corresponds to multi-window display, 
and 

said second generation means acquires infor- 
mation about window display which is to be ex- 
changed between an application program and 
an operating system, and generates the area 
information on the basis of the information 
about window display. 

23. The apparatus according to claim 22, further com- 
prising determination means (S1 06) for determining 
for each of the plurality of windows whether data 
corresponding to 3D display is contained, and 

wherein said second generation means gener- 
ates the area information on the basis of a dis- 
play area of a window determined as a window 
containing data corresponding to 3D display by 
said determination means. 

24. The apparatus according to claim 22, wherein said 
determination means generates the area informa- 
tion on the basis of a display area of a window, of 
the plurality of windows, which is active and con- 
tains data corresponding to 3D display. 



25 27. The method according to claim 26, further compris- 
ing the third generation step (S1 2, S1 3, S21 ) of gen- 
erating display mode information indicating whether 
to perform mixed display of 2D and 3D images, and 



30 



35 



wherein the control step comprises controlling 
2D image display and 3D image display per- 
formed by said image display apparatus when 
the display mode information indicates execu- 
tion of mixed display. 

28. The method according to claim 27, further compris- 
ing the setting step (S1 2, Figs. 5 to 9) of performing 
a setting operation to determine whether to perform 
mixed display of 2D and 3D images, and 

wherein the third generation step comprises 
generating the display mode information on the 
basis of contents set by in the setting step. 



45 29. The method according to claim 28, wherein said im- 
age display system further comprises said image 
display apparatus and a host apparatus for supply- 
ing image data to said image display apparatus, and 



40 



so 



55 



the setting step is incorporated in software ex- 
ecuted by said host apparatus. 

30. The method according to claim 29, wherein the soft- 
ware is incorporated in an operating system. 

31 . The method according to claim 29, wherein the soft- 
ware is incorporated in an application program. 
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32. The method according to claim 28, wherein said im- 
age display system further comprises said image 
display apparatus and a host apparatus for supply- 
ing image data to said image display apparatus, and 

the setting step is incorporated in software ex- 
ecuted by said image display apparatus. 

33. The method according to claim 27, wherein the first 
generation step comprises converting 3D display 
image data into 2D display image data when the dis- 
play mode information generated in the third gen- 
eration step indicates a mode of displaying only a 
2D image. 

34. The method according to claim 26, wherein the im- 
age data corresponds to multi-window display, and 

the second generation step comprises acquir- 
ing formation about window display which is to 
be exchanged between an application program 
and an operating system, and generating the 
area information on the basis of the information 
about window display. 

35. The method according to claim 34, further compris- 
ing the determination step (S1 06) of determining for 
each of the plurality of windows whether data cor- 
responding to 3D display is contained, and 

wherein the second generation step comprises 
generating the area information on the basis of 
a display area of a window determined as a win- 
dow containing data corresponding to 3D dis- 
play in the determination step. 

36. The method according to claim 34, wherein the de- 
termination step comprises generating the area in- 
formation on the basis of a display area of a window, 
of the plurality of windows, which is active and con- 
tains data corresponding to 3D display 

37. The method according to claim 34, wherein the de- 
termination step comprises generating the area in- 
formation on the basis of a display area of a window, 
of the plurality of windows, which contains data cor- 
responding to 3D display and designated as a win- 
dow to be subjected to 3D display. 

38. A method of controlling an image display apparatus 
including an image display unit capable of perform- 
ing mixed display of 2D and 3D images, character- 
ized by comprising: 

the first reception step (S31 ) of receiving image 
data to be displayed on said image display ap- 
paratus; 

the second reception step (S31 ) of receiving ar- 



ea information indicating a 3D image area of 
the image data; and 

the control step (S33 - S37) of controlling 2D 
image display and 3D image display on the ba- 
5 sis of the area information when an image 

formed by the image data is to be displayed. 

39. The method according to claim 38, further compris- 
ing the third reception step (S31) of receiving dis- 
10 play mode information indicating whether to per- 
form mixed display of 2D and 3D images, and 

wherein the control step comprises controlling 
2D image display and 3D image display per- 
*5 formed by said image display unit on the basis 

of the area information when the display mode 
information indicates execution of mixed dis- 
play. 

20 40. The method according to claim 38, further compris- 
ing 

the setting step (S32, Figs. 6 and 9) of setting 
a display mode indicating whether to perform 

25 mixed display of 2D and 3D images, and 

the notification step (221) of notifying a source 
device of the image data of the display mode 
information set by the setting step, and 
wherein the control step comprises controlling 

30 2D image display and 3D image display per- 

formed by said image display apparatus on the 
basis of the area information when the display 
mode set in the setting step indicates execution 
of mixed display. 

35 

41. A method of controlling an information processing 
apparatus which can be connected to an image dis- 
play apparatus capable of performing mixed display 
of 2D and 3D images, characterized by comprising: 

40 

the first generation step (S1 4) of generating im- 
age data containing both 2D and 3D image da- 
ta; 

the second generation step (S1 5) of generating 
45 area information indicating a 3D display area of 

the image data generated in the first generation 
step; and 

the output step (S16) of outputting the image 
data and the area information to said image dis- 
so play apparatus. 

42. The method according to claim 41 , further compris- 
ing the third generation step (S 1 3) of generating dis- 
play mode information indicating whether to per- 

55 form mixed display of 2D and 3D images, and 

wherein the output step comprises outputting 
the image data, the area information, and the 



12 



23 



EP 0 860 807 A2 



24 



display mode information to said image display 
apparatus. 

43. The method according to claim 42, further compris- 
ing the setting step (Figs. 5, 7, and 8) of performing 
a setting operation to determine whether to perform 
mixed display of 2D and 3D images, and 

wherein the third generation step comprises 
generating the display mode information on the 
basis of contents set in the setting step. 

44. The method according to claim 42, wherein the first 
generation step comprises converting 3D display 
image data into 2D display image data when the dis- 
play mode information generated by in the third 
generation step indicates a mode of displaying only 
a 2D image. 

45. The method according to claim 41 , wherein the im- 
age data corresponds to multi-window display, and 

the second generation step comprises acquir- 
ing information about window display which is 
to be exchanged between an application pro- 
gram and an operating system, and generates 
the area information on the basis of the infor- 
mation about window display. 



a code of the first reception step of receiving 
image data to be displayed on said image dis- 
play apparatus; 

a code of the second reception step of receiving 
area information indicating a 3D image area of 
the image data; and 

a code of the control step of controlling 2D im- 
age display and 3D image display on the basis 
of the area information when an image formed 
by the image data is to be displayed. 

50. A storage medium storing a control program for 
generating display information for an image display 
apparatus capable of performing mixed display of 
2D and 3D images, the control program comprising: 

a code of the first generation step of generating 
image data containing both 2D and 3D image 
data; 

a code of the second generation step of gener- 
ating area information indicating a 3D display 
area of the image data generated in the first 
generation step; and 

a code of the output step of outputting the im- 
age data and th e area information to said image 
display apparatus. 

51 . An image display system, comprising: 



46. The method according to claim 45, further compris- 
ing the determination step (S106) of determining for 
each of the plurality of windows whether data cor- 
responding to 3D display is contained, and 

wherein the second generation step comprises 
generating the area information on the basis of 
a display area of a window determined as a win- 
dow containing data corresponding to 3D dis- 
play in the determination step. 

47. The method according to claim 45, wherein the de- 
termination step comprises generating the area in- 
formation on the basis of a display area of a window, 
of the plurality of windows, which is active and con- 
tains data corresponding to 3D display. 

48. The method according to claim 45, wherein the de- 
termination step comprises generating the area in- 
formation on the basis of a display area of a window, 
of the plurality of windows, which contains data cor- 
responding to 3D display and designated as a win- 
dow to be subjected to 3D display. 

49. A storage medium storing a control program for 
controlling an image display apparatus including an 
image display unit capable of performing mixed dis- 
play of 2D and 3D images, the control program com- 
prising: 



30 image display apparatus operable to display 2D 

and 3D images at the same time in different 
parts of a display; and 

control apparatus for controlling the image dis- 
play apparatus; 

35 

wherein the control apparatus is arranged to: 

transmit image data to the display apparatus 
defining at least one 3D image to be displayed; 
40 and 

generate, and transmit to the display appara- 
tus, control data defining a display parameter 
for the 3D image; and 

wherein the display apparatus is arranged to 
45 display the 3D image and a 2D image on the 

basis of the received control data. 

52. A system according to claim 51 , wherein the control 
data defines a size parameter of the 3D image. 

so 

53. A system according to claim 51 or claim 52, wherein 
the control apparatus is further operable to gener- 
ate the image data defining the 3D image. 

55 
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